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Abstract 

The independence numbers of powers of graphs have been long studied, under several def- 
initions of graph products, and in particular, under the strong graph product. We show that 
, the series of independence numbers in strong powers of a fixed graph can exhibit a complex 

structure, implying that the Shannon Capacity of a graph cannot be approximated (up to a 
sub-polynomial factor of the number of vertices) by any arbitrarily large, yet fixed, prefix of the 
series. This is true even if this prefix shows a significant increase of the independence number 
£N| . at a given power, after which it stabilizes for a while. 

o 

oo 
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^ ■ 1 Introduction 

Given two graphs, G\ and G?2, their strong graph product G\ ■ G2 has a vertex set V(G\) x V^G^), 
and two distinct vertices («i,«2) and (111,112) are connected iff they are adjacent or equal in each 
coordinate (i.e., for i 6 {1,2}, either Vi = Ui or V{U\ G E(Gi)). This product is associative and 
commutative, and we can thus define G as the product of k copies of G. In [IT], Shannon introduced 
the parameter c(G), the Shannon Capacity of a graph G, which is the limit lim^oo y a(G k ), 
where a(G k ) is the independence number of G k (it is easy to see that this limit exists by super- 
multiplicativity) . The considerable amount of interest that c(G) has received (see, e.g., pQ, [2], [5], 
[0], 0, jSj, [S], |1U| . \V2\ ) is motivated by Information Theory concerns: this parameter represents 
the effective size of an alphabet, in a communication model where the graph G represents the 
channel. In other words, we consider a transmission scheme where the input is a set of single letters 
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V = {1, . . . , n}, and our graph G has V as its set of vertices, and an edge between each pair of 
letters, iff they are confusable in transmission (i.e., (1,2) G E(G) indicates that sending an input 
of 1 or an input of 2 might result in the same output). Clearly a{G) is the maximum size of a set 
of single letters which can be predefined, then sent with zero-error. By definition, a(G k ) represents 
such a set of words of length k (since two distinct words are distinguishable iff at least one of their 
coordinates is distinguishable), leading to the intuitive interpretation of c{G) as the effective size 
of the alphabet of the channel (extending the word length to infinity, while normalizing it in each 
step). 

Consider the series a k = afc(G) = \j a(G k ), which we call "the independence series of G". As 
observed in the limit c(G) = lim^oo o-k exists and equals its supremum, and a m k > ak for 
all integers m, k. Our motivation for the study of the series a& is the computational problem of 
approximating c(G). So far, all graphs whose Shannon capacity is known, attain the capacity either 
at ai (the independence number, e.g., perfect graphs), a 2 (e.g., self complementary vertex-transitive 
graphs) or do not attain it at any ak (e.g., the cycle C5 with the addition of an isolated vertex). 
One might suspect that once the series remains roughly a constant for several consecutive values 
of k, its value becomes a good approximation to its limit, c(G). This, however, is false. Moreover, 
it remains false even when restricting ourselves to cases where a k increases significantly before it 
stabilizes for a few steps. We thus address the following questions: 

1. Is it true that for every arbitrarily large integer k, there is a 5 = 5{k) > and a graph G on 
n vertices such that the values {aj}j<fc are all at least n s - far from c(G)? 

2. Can the series ak increase significantly (in terms of n = |1^(G)|) in an arbitrary number of 
places? 

In this short paper we show that the answer to both questions above is positive. The first question 
is settled by Theorem^ proved in section^ 

Theorem 1. For every fixed y£N and e > there exists a graph G on N vertices such that for 
all k < v, 0^ < Cfc log 2 (-/V) (where Ck = Ck, u )> yet a u > N~ . 

Indeed, for any fixed k, there exists a graph G on N vertices, whose Shannon Capacity satisfies 
c{G) > N 5 maxi < k{ai}, where 5 = X ~f ^ . 

Theorem |^1 proved in section |3 settles the second question, and implies the existence of a graph 
G whose independence series contains an arbitrary number of "jumps" at arbitrarily chosen 
locations; hence, noticing a significant increase in this series, or noticing that it stabilizes for a 
while, does not ensure any proximity to c(G). 

Theorem 2. For every fixed v\ < . . . < v s G N and e > there exists a graph G such that for all 
k < u it a k < a%. (i G {!,.. -,s}). 
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The above theorems imply that the naive approach of computing the at values for some k 
does not provide even a PSPACE algorithm for approximating c(G). Additional remarks on the 
complexity of the problem of estimating c(G), as well as several open problems, appear in the final 
section @J 



2 The capacity and the initial a&-s 

In this section we prove Theorem using a probabilistic approach, which is based on the method 
of [3], but requires some additional ideas. 

Let 2 < v G N; define N = nu (n will be a sufficiently large integer) , and let V(G) = {0, . . . ,N— 1}. 
Let 1Z denote the equivalence relation on the set of unordered pairs of distinct vertices, in which 
(x, y) is identical to (y, x) and is equivalent to (x + kn, y + kn) for all < k < v — 1, where addition 
is reduced modulo N. Let {TZi, ■ ■ ■ ,TZm} denote the different equivalence classes of 1Z. For every 
x ^ y, let lZ(x,y) denote the equivalence class of (x,y) under TZ; then either \lZ(x,y)\ is precisely 
v, or the following equality holds for some I <v: 

(x, y) = (y + In, x + In) (mod N) 

This implies that N | 2ln, hence 2l = v. We deduce that if v is odd, |7^| = v for all 1 < % < M, 
and M = 1{ N 2 ). If v is even: 



7p If y = x + si/n, 
Otherwise. 



and M = ^(^) + ^j-W) i- e -i m case of an even there are N/2 pairs which belong to n smaller 
classes, each of which is of size ^is, while the remaining edges belong to ordinary edge classes of 
size v. 

The edges of G are chosen randomly, by starting with the complete graph and excluding a sin- 
gle edge from each equivalence class, uniformly and independently, thus = ( 2 ) — M = 

(?) + «(!))■ 

A standard first moment consideration (c.f., e.g., |H) shows that a\ = a(G) < \2log u (N)~\ almost 
surely. To see this, set s = \2\og u (N)~\, and take an arbitrary set S C V(G) of size s. If S contains 
more than one member of some edge class TZi, it cannot be independent. Otherwise, its edge prob- 
abilities are independent, and all that is left is examining the lengths of the corresponding edge 
classes. Assume S contains r pairs which belong to short edge classes: (x\,yi), . . . , (x r ,y r ). If v is 
odd, r = 0, otherwise j/j = xi + \vn for all i, and Xj 7^ Xj (mod ^yn) for all i 7^ j (distinct pairs in 
S belong to distinct edge classes). It follows that r < f , and we deduce that for each such set S: 



1 \ \2)~ T /2V / 1 \ b 
Pr[5 is independent] < ( — J ( — J < ( — 



ys/2 
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Applying a union bound and using the fact that — tends to as N, and hence s, tend to 
infinity, we obtain: 

PrWO) > .] < < ^ {Nv-^)° = <^ (iV,-f)" < ^f- = „(1) , 

where the o(l) term here, and in what follows, tends to as JV tends to infinity. 

We next deal with G k for 2 < k < v. Fix a set S 1 C F(G fe ) of size s = \c k log^iV)] , where c k will 
be determined later. Define S' , a subset of 5, in the following manner: start with S" = (j), order the 
vertices of S arbitrarily, and then process them one by one according to that order. When processing 
a vertex v = {v i, . . . , v k ) G S, we add it to S", and remove from S all of the following vertices which 
contain Vi + tn (mod iV) in any of their coordinates, for any i G [&;] and t & {0, . . . ,v — 1}. In 
other words, once we add v to S", we make sure that its coordinates modulo n will not appear 
anywhere else in S'. If S is independent, it has at most a(G k ~ l ) vertices with a fixed coordinate, 
thus s' = \S'\ > s/ (k 2 ■ v ■ a(G k ~~ 1 )). Notice that each two distinct vertices u,v G S' have distinct 
vertices of G in every coordinate, thus lZ(ui,Vi) is defined for all i; furthermore, for any other pair 
of distinct vertices u', v' G S", the sets {1Z{u\, v±), . . . ,lZ(uk,Vk)} and {lZ(u[, v[), . . . ,lZ(u' k ,v' k )} are 
disjoint. 

We next bound the probability of an edge between a pair of vertices u ^ v G S' . Let k' denote 
the number of distinct pairs of corresponding coordinates of u,v, and let ti, 1 < I < M, be the 
number of all such distinct pairs whose edge class is 1Z\ (obviously YlbLih = ^')- For example, 
when all the corresponding pairs are distinct, we get k' = k and t[ = \{1 < i < k : lZ(iii,Vi) = TZ[}\. 
Notice that, by definition of S', for every i, Vi / Ui + \vn, and thus lZ(iti,Vi) is an ordinary edge 
class. It follows that: 

M - 1 

Pi[uv G E{G k )\ = \{ V —± (1) 
l=i V 

This expression is minimal when ti = k! for some /, since replacing t; x , t\ 2 > with i| = t\ x +ti 2 , t' l2 = 
strictly decreases its value. Therefore Pr[uv ^ E(G k )) < ^ < ^. Notice that, crucially, by the 
structure of 5', as each edge class appears in at most one pair of vertices of S", the events uv ^ E{G k ) 
are independent for different pairs u, v. Let Ag> denote the event that there is an independent set 
S' of the above form of size s' = \d log 2 (iV)] , where d = 2k 2 . Applying the same consideration 
used on S and G to S' and G k , gives (assuming is sufficiently large): 

< N ks '2~^ s ' 2lo ^W < 2 (^'-|io g2 (£) c ' 2 )io g 2(iv) 

Now, our choice of d should satisfy d > log 2 ^^ for this probability to tend to zero. Whenever 
2 < k < | we get Hog 2 (£) > k > 1, thus d = 2k 2 > log ^ . For | < k < v we have 1 < f < 2 

and thus log 2 (|) > | — 1. Taking any d > would be sufficient in this case, hence d = 2k 2 will 
do. Overall, we get that PrLAg/] tends to as N tends to infinity. 
Altogether, we have shown that for every 2 < k < v: 

a(G k ) < k 2 ua{G k - l )2k 2 \og 2 {N) = 2k 4 u log 2 (N)a(G k ~ 1 ) 
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Hence, plugging in the facts that a(G) < 21ogj,(iV) < 21og 2 (iV) and 2 2 ml < m m for m > 2, we 
obtain the following bound for all k G {1, . . . ,v — 1}: 

a(G fc ) < 2 fc (A;!) 4 i/ fc - 1 log^'(A r ) < 2~ k k ik v k - 1 log^(iV) 

a fc <^ 4 i/log 2 (A0< Vlog 2 (A0 

It remains to show that a v is large. Consider the following set of vertices in G v (with addition 
modulo N): 

I = { x = (x, x + n, . . . , x + (u - l)n) | < x < N } (2) 

Clearly / is independent, since for any < x < y < N, the corresponding coordinates of x, y form 
one complete edge class, thus exactly one of these coordinates is disconnected in G. This implies 
that a v >Nv. 

Hence, we have shown that for every value of v, there exists a graph G on N vertices such that: 

ai<Ci\og 2 {N) (i = l,...,v-l) 
a v >N^ 

■ 

We note that a simpler construction could have been used, had we wanted slightly weaker results, 
which are still asymptotically sufficient for proving the theorem. To see this, take N = nv and start 
with the complete graph Kpj. Now order the N vertices arbitrarily in n rows (each of length u), 
as (vij) (1 < i < n, 1 < j < v). For each pair of rows choose (independently) a single column 
1 < j < v, and remove the edge VijVi'j from the graph. This gives a graph G with (^) — (2) edges. 
A calculation similar to the one above shows that with high probability < Ck log 2 (iV) for k < u, 
and yet a(G u ) > n (as opposed to N in the original construction), hence a u > (^) " > \N». 



3 Graphs with an irregular independence series 

Theorem |2] states that there exists a graph G whose independence series exhibits an arbitrary 
(finite) number of jumps. Our first step towards proving this theorem is to examine the behavior 
of fixed powers of the form k > v for the graphs described in the previous section. We show that 
these graphs, with high probability, satisfy aj- = (1 + O(logiV)) iVL~J k : for every fixed k > v. The 
notation at = (1 + 0(log JV)) N a , here and in what follows, denotes that N a < at < c^^log^ 

I k 1 1 

for a fixed c > 0. The lower bound of iVL~Ji for can be derived from the cartesian product 
of the set I, defined in ©, with itself, [^J times; the upper bound is more interesting. Fix an 
arbitrary set S, as before, however, this time, prior to generating S', we first remove from S all 
vertices which contain among their coordinates a set of the form {x, x + n, . . . , x + (y — l)n}. This 
amounts to at most (^jv\na(G k ~' 1 ') vertices. This step ensures that S will not contain vertices that 
share a relation, such as the one appearing in the set I defined in (|2"|). However, an edge class may 
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still be completely contained in the coordinates of u, v £ 5, in an interlaced form, for instance: 
u = (x,y + n,x + 2n, . . . ,x + (u — l)n, . . .) and v = (y,x + n,y + 2n, . . . ,y + (u— l)n, . . .). This will 
be automatically handled in generating S', since all vectors v with x + tn in any of their coordinates 
are removed from S' after processing the vector u. Equation © remains valid, with tj < v for all 
i, however now me must be more careful in minimizing its right hand side. We note that for every 
< ti, tj < v — 1, setting t\ = v — 1, t'j = U + tj — i- reduces the product of — * J ■ Therefore, 
again denoting by fc' the number of distinct pairs of corresponding coordinates, we obtain the 
following bound on the probability of the edge uv: 

Pr[™ <= E (G*)] > fi ^-' fc,m ° d "-- 1 » > (I) ^ > f * (4) 



Thus: 

Pr[w £ £(G fc )] < e-(^)^ 

Now, the same consideration that showed a(G) < 21og„(iV) implies that any set 5' generated from 
S in this manner, which is of size s > 2kv v - 1 log(iV), is almost surely not independent (for the sake 

k 

of convenience, we set p = e"^) 1 ^). Indeed, the probability that there is such an independent 
set S' is at most: 

r N k \ /b'\ p- s '/2 , B , v > p s'/2 / s f -.'/2 



s' 



Jp( a ) < (jV*p T ) = ^__exp^log(iV)--z,-— J <^- 7r = (l) 



(5) 



Thus, almost surely, |5 | < 2kw- 1 log(iV). Altogether, we have: 

a(G k ) < (^j u\na{G k - v ) + k 2 va(G k ~ 1 ) ■ 2kv^ log(iV) 

= (i/ - X)\Na[G k ~ v ) + 2fcV + ^ ]og{N)a(G k ~ 1 ) 

For k = v and a sufficiently large N, we get 

iV<a(G") <iV(^-l)! + 2^ 5+ ^Tlog(iV)(c I/ _ilog 2 (iV))^ 1 <N\og 2 (N) (6) 

Set di = . . . = djz-i = 0, d v = 1 and = Ak? v l+ ~" zr[ dk-i for k > v. It is easy to verify that 
> C)(^ ~~ l)!^fc-i» and > 2k 3 u 1+ '^ d^-i- Hence, by induction, equations © and © 
imply that for all k > v: 

a(G k ) < d k N^ \og k 2 {N) 

By definition of the d k series, 

3 



d k < 4 k ~» 



Hence, 

l<-^x<\/2& 3 ^ log 2 (iV) 
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as required. 

Let us construct a graph whose independence series exhibits two jumps (an easy generalization will 
provide any finite number of jumps). Take a random graph, G%, as described above, for some index 
v\ and a sufficiently large number of vertices Ni, and another (independent) random graph, G2 for 

some other index 1/2 > v\, on N2 = N l 1/1 vertices (when a > 1). Let G = G\ ■ G2 be the strong 
product of the two graphs; note that G has N = N1N2 vertices. It is crucial that we do not take 
G\ and G2 with jumps at indices v\, v% respectively separately, but instead consider the product G 
of two random graphs constructed as above. We claim that with high probability, G satisfies: 



a k {G) 



O (log iV) k<v x 
\ — \- 

(1 + 0(log N)) N1 1 k v\ <k < V2 

(l + 0(logiV))iV 2 L ^ J ^ k>v 2 



i.e., for v\ <k < V2 which is a multiple of v\, we have a k = (1 + O(logiV)) A r,/ i+ Q ' / 2 • for k > v% 



which is a multiple of U2 we have a k = (1 + O(logiV)) N Ly i+°""2 . Therefore, we get an exponential 
increase of order a at the index and obtain two jumps, as required. 

To prove the claim, argue as follows: following the formerly described methods, we filter an arbitrary 
set S C V{G k ) to a subset S', in which every two vertices have a positive probability of being 
connected, and all such events are independent. This filtering is done as before - only now, we 
consider the criteria of both Gi and G2 when we discard vertices. In other words, if we denote by 
u 1 ,!! 2 the fc-tuples corresponding to G\ and G\ of a vertex u € V{G k ), then a vertex u G S filters 
out the vertex v from S iff u 1 would filter out v 1 in G\ or u 2 would filter out v 2 in G\ (or both). 
Recall that, by the method S' is generated from S, no two vertices in S' share an identical /c-tuple 
of G\ or of G\. Hence, two vertices u,v G S' are adjacent in G k iff they are adjacent both in G\ 
and in G\. These are two independent events, thus, by (J2) and (j3J, we get the following fixed lower 
bound on the probability of u and v being adjacent: 

Pi[uv e E(G k )} = Pr[uV G E(G\)] Pr[uV G E(G$)] > 

This provides a bound of 0(log N) for the size of S' . Combining this with the increase in the values 
of {a k } at indices v\ and V2 {a Vi > Np for i = 1, 2) proves our claim. 

In order to obtain any finite number of jumps, at indices u±, . . . , v s , simply take a sufficiently large 

a - 1 

Ni and set Ni = N-^ 1 for 1 < i < s, where a > 1. By the same considerations used above, with 
high probability the graph G = G\ ■ . . . ■ G s (where Gi is a random graph designed to have a jump 
at index i>i almost surely) satisfies a v . > a£ for all k < v^. Hence for every e > we can choose 
a > i and a sufficiently large N\ so that a k < a%. for all k < U{. This completes the proof. ■ 
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4 Concluding remarks and open problems 



We have shown that even when the independence series stabilizes for an arbitrary (fixed) number 
of elements, or jumps and then stabilizes, it still does not necessarily approximate the Shannon 
capacity up to any power of e > 0. However, our constructions require the number of vertices to be 
exponentially large in the values of the jump indices z/j. We believe that this is not a coincidence, 
namely a prefix of linear (in the number of vertices) length of the independence series can provide a 
good approximation of the Shannon capacity. The following two specific conjectures seem plausible: 

Conjecture 3. For every graph G on n vertices, maxfa^Kn > ^c(G), that is, the largest of the 
first n elements of the independence series gives a 2- approximation for c{G). 

Conjecture 4. For every e > there exists an r = r(e) such that for a sufficiently large n and for 
every graph G on n vertices, the following is true: max{at},t<ii r > (1 — e)c{G). 

Our proof of Theorem ^ shows the existence of a graph whose independence series increases by 
a factor of N s at the k-th. power, where S = ■ It would be interesting to decide if there is a 

graph satisfying this property for a constant 5 > (independent of k). This relates to a question on 
channel discrepancy raised in where the authors show that the ratio between the independence 
number and the Shannon capacity of a graph on n vertices can be at least n2~°( 1 \ and ask whether 
this is the largest ratio possible. Proving Theorem^for a constant 5 > will give a negative answer 
for the following question, which generalizes the channel discrepancy question mentioned above: 

Question 5. Does max{aj}j<fc, for any fixed k > 2, approximate c(G) up to a factor of nk + °^ 
(where n = \V(G)\)9 

Although our results exhibit the difficulty in approximating the Shannon capacity of a given graph 
G, this problem is not even known to be NP-hard (although it seems plausible that it is in fact 
much harder) . We conclude with a question concerning the complexity of determining the value of 
c(G) accurately for a given graph G: 

Question 6. Is the problem of deciding whether the Shannon Capacity of a given graph exceeds a 
given value decidable? 

References 

[1] N. Alon, Explicit Ramsey graphs and orthonormal labelings, The Electronic Journal of 
Combinatorics, 1 (1994), R12, 8pp. 

[2] N. Alon, The Shannon capacity of a union, Combinatorica 18 (1998), 301-310. 

[3] N. Alon and A. Orlitsky, Repeated communication and Ramsey graphs, IEEE Transactions 
on Information Theory 41 (1995), 1276-1289. 



8 



[4] N. Alon and J. H. Spencer, The Probabilistic Method, Second Edition, Wiley, New York, 
2000. 

[5] T. Bohman, A limit theorem for the Shannon capacities of odd cycles. I., Proc. Amer. 
Math. Soc. 131 (2003), no. 11, 3559-3569 (electronic). 

[6] T. Bohman and R. Holzman, A nontrivial lower bound on the Shannon capacities of the 
complements of odd cycles. IEEE Trans. Inform. Theory 49 (2003), no. 3, 721-722. 

[7] W. Haemers, An upper bound for the Shannon capacity of a graph, Colloquia Mathematica 
Societatis Janos Bolyai, 25: Algebraic Methods in Graph Theory, Szeged (Hungary), 1978, 
267-272. 

[8] W. Haemers, On some problems of Lovasz concerning the Shannon capacity of a graph, 
IEEE Transactions on Information Theory, 25(2) (1979), 231-232. 

[9] L. Lovasz, On the Shannon capacity of a graph, IEEE Transactions on Information Theory 
IT-25, pages 1-7, 1979. 14 

[10] A. Schrijver, A comparison of the Delsarte and Lovasz bounds, IEEE Trans. Inform. Theory, 
25(4):425-429, 1979. 

[11] C. E. Shannon, The zero-error capacity of a noisy channel, IRE Transactions on Information 
Theory, 2(3):8-19, 1956. 

[12] J.H. van Lint and R.M. Wilson, A Course in Combinatorics. Second Edition. Cambridge 
University Press, Cambridge, 2001. 



9 



